Combining Goal Inference and Natural-Language Dialogue for Human-Robot Joint Action
نویسندگان
چکیده
We demonstrate how combining the reasoning components from two existing systems designed for human-robot joint action produces an integrated system with greater capabilities than either of the individual systems. One of the systems supports primarily non-verbal interaction and uses dynamic neural fields to infer the user’s goals and to suggest appropriate system responses; the other emphasises natural-language interaction and uses a dialogue manager to process user input and select appropriate system responses. Combining these two methods of reasoning results in a robot that is able to coordinate its actions with those of the user while employing a wide range of verbal and non-verbal communicative actions.
منابع مشابه
Symmetrical joint action in human-robot dialogue
We describe a model for task-driven, naturallanguage-based human-robot interaction where the roles of the two participants are fully interchangeable, both at the conversational level and at the task level. This model provides a general treatment of joint-action dialogue, and also allows models based on the analysis of human-human joint-action dialogues easily to be implemented and evaluated. I....
متن کاملToward Interpreting Spatial Language Discourse with Grounding Graphs
In order to interact naturally with humans, robots must be able to engage in natural language dialog with their human teammate. To do so they need to model not only the state of the world but also the state of the interaction with the human user. In this paper we present an algorithm for understanding dialog in which information from multiple dialog turns is dynamically integrated into a probab...
متن کاملSpecification and interpretation of multimodal dialogue models for human-robot interaction
In this paper a conceptual model for the design and construction of interactive multimodal systems is presented. This model is based on a representational language for the specification of dialogue models and its associated program interpreter. Dialogues models are domain and modality independent conversational schemes characterizing the dynamic of a multimodal interaction, and domain specific ...
متن کاملGrounding Imperatives to Actions is Not Enough: A Challenge for Grounded NLU for Robots from Human-Human Data
We present a proposal for a Natural Language Understanding method for simple pick-and-place robots which maps utterances to different levels in an action hierarchy. The hierarchy is a graph containing both lower-level action and higher-level goal levels. This attempts to overcome the surprising lack of overt imperative verb forms in natural task-oriented dialogue, which we show to be the case s...
متن کاملCase-Based Techniques Used for Dialogue Understanding and Planning in a Human-Robot Dialogue System
We describe an approach to the use of case-based techniques for natural language understanding and for action planning in a system for dialogue between a human and a robot, which in our case is a UAV (unmanned aerial vehicle). A single case base and case-based reasoning engine is used both for understanding and for planning actions by the UAV. This approach has been developed through the work o...
متن کامل